Analytic treatment of the network synchronization problem with time delays 
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Motivated by novel results in the theory of network synchronization, we analyze the effects 
of nonzero time delays in stochastic synchronization problems with linear couplings in an arbitrary 
network. We determine analytically the fundamental limit of synchronization efficiency in a noisy 
environment with uniform time delays. We show that the optimal efficiency of the network is 
achieved for At = 2 ^/ +4 « 0.738, where A is the coupling strength (relaxation coefficient) and r 
is the characteristic time delay in the communication between pairs of nodes. Our analysis reveals 
the underlying mechanism responsible for the trade-off phenomena observed in recent numerical 
simulations of network synchronization problems. 



Synchronization processes in populations of locally in- 
teracting elements are in the focus of intense research 
in physical, biological, chemical, technological and so- 
cial systems [l]. Of particular interest are situations in 
which members (usually referred to as 'agents' or 'nodes' 
in a network) try to coordinate their state in a decen- 
trakzed manner Q |. In many real-life situations the 
motivation for such coordination is to improve the global 
performance of the network 0] ■ There has been a flurry 
of research focusing on the efficiency and optimization 
of synchronization problems in various complex network 
topologies (see |lril3| and references therein). 

Stochastic synchronization problems in real biological, 
social, and computing networks are usually characterized 
by finite time delays in the communication between pairs 
of nodes. Recently, Hunt et al. Q have studied the 
impact of such time delays on synchronizability and on 
the breakdown of synchronization in dynamical network- 
connected systems. They considered a stochastic model 
in which each node in a network adjusts its state to match 
that of its neighbors, but with a uniform time lag in react- 
ing to the neighborly feedback. Hunt et al. have revealed 
that there are trade-offs in the synchronization problem: 
when there are large lag times in communication between 
nodes, reduced local coordination effort may actually im- 
prove the global coordination of the network Q. 

It is worth emphasizing that the remarkable finding 
of Q, that there are possible scenarios for trade-offs 
between large time lags and the coupling strength, is 
based on numerical simulations of the stochastic evolu- 
tion equations which govern the dynamics of the network 
[see Eq. ([6]) below]. The main goal of the present Letter 
is to provide an analytical treatment for the network syn- 
chronization problem. In particular, we shall determine 
analytically the fundamental limit of synchronization ef- 
ficiency in a noisy environment with uniform time delays. 

We shall first describe the synchronization model stud- 
ied in Ref. Consider a stochastic model where N 
agents in a network locally adjust their state in an at- 
tempt to match that of their neighbors. Such coordina- 



tion may improve the global performance of the network 
[E 0- S IS 0|- As in many real- life situations, the com- 
munication between pairs of nodes is not instantaneous. 
Rather, it is characterized by some finite time lag Q. 
The dynamics of the system is governed by the coupled 
stochastic equations of motion with linear local relax- 
ation and a uniform time delay, 



dhjjt) 
dt 



N 



= -^C ij [h i {t-T)-h j {t-T)]+r H (t) , (1) 



where hi (t) is the generalized local state variable on node 
i, Cij — Cji > is the symmetric coupling strength be- 
tween two connected nodes i and j, and r is the charac- 
teristic time delay between two connected nodes. Here 
rji (t) is a delta-correlated noise with zero mean and vari- 
ance (rji(t)rjj(t')) — 2D5ij5(t — t'), where D is the noise 
intensity [2|. 

Stochastic synchronization problems are characterized 
by competition between a relaxation mechanism and a 
random noise. The physically interesting observable in 
such systems is the width of the synchronization land- 
scape. This is given by H[ 



(w 2 (t)) 



1 N 



h(t)) 



(2) 



where h(t) = 1/N^2 i=1 hi(t) is the global average of the 
local state variables and (•••) denotes an ensemble average 
over the noise. A network is considered synchronizable 
if its late-time asymptotic behavior is characterized by a 
finite width [that is, if (w 2 (oo)) < oo]. The smaller the 
width, the better the synchronization 

The coupled equations of motion (JTJ) can be rewritten 
as [2| 



dhjjt) 
dt 



N 



ftrf(t-T)+th-(*) 



(3) 
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where Ty = Sij J^i^u ~ ^ij 1S the symmetric network Writing the characteristic equation §8§ in the form 



Laplacian. Further, by diagonalizing the network Lapla- 
cian, one can decompose the problem into N independent 
modes 



dk(t) 
dt 



= -X k hk{t - 



(4) 



where {\k} {k — 0, 1, 2, N — 1) are the eigenvalues of 
the network Laplacian and {ftk{i)T)i{t')) = 2D5ki5{t — t'). 
For a connected (single-component) network, the Lapla- 
cian has a single zero mode (indexed by k — 0) with 
Ao = 0, while > for k > 1 0. Using the above 
cigcnmodc decomposition, the width of the synchroniza- 
tion landscape can be expressed as 0] 



AT-l 



(w 2 (t)) 



(5) 



k=l 



Note that the eigenmodes of the system are governed 
by a stochastic equation of motion [Eq. (j4])] of identical 
form for all k > 1. We shall therefore omit the index k 
for brevity, and study the stochastic differential equation 



dh(t) 
dt 



-Xh(t-r) +fj(t) 



(G) 



with (rj(t)ri(t')) = 2D5(t - t'). 

Using a Laplace transformation with initial conditions 
h{t < 0) = 0, one finds @ 



h(t)= / dt>f)(t>)Y,T 



«(«-*') 



+ TS C 



(7) 



where {s a } (a = 1, 2, ...) are the solutions of the charac- 
teristic equation 



s + Ae~ 







(8) 



in the complex plane. The characteristic equation (|SJ) 
has an infinite number of complex solutions for r > 
nj, |l5[ . In particular, it is well known that §l(s a ) < 
for all a provided Ar < ir/2 111. IbH. fTBIj . 
Using Eq. Q, one finds [2| 



(^ 2 W) = EE 7i 



-2Dr[l - e 



(2; 0! +z^)t/rl 



(1 + Z a )(l + Zp)(z a + Zp) 



(9) 



for the noise-averaged fluctuations, where z = rs. In- 
spection of Eq. © reveals that the condition for (h 2 (oo)) 
to remain finite is $l(z a ) < for all a. As discussed 
above, this requires At < n/2 [l6j |. In the synchronizable 
regime [3f?(z Q ) < for all a] one finds 



<*V)> = EE 7i 



-2L>t 



(1 + z Q )(l + z^)(z Q + 2^) 



(10) 



for the steady-state (t — > oo) behavior. 



2 + Are 



, 



(11) 



one realizes that z Q = z Q (Ar) [2|. Thus, one immediately 
deduces from Eq. (fT0| the scaling form 



(/i 2 (oo)) =flrx /(A) 



(12) 



where A = Ar. The scaling function /(A) was con- 
structed numerically in 0]. In particular, the numerical 
study of /(A) in yielded the remarkable finding that 
/(A) is a non-monotonic function; it exhibits a single 
minimum, at approximately A* « 0.73 with /(A*) 3.1 
(see Fig. 2 of 0|). 

Our main goal here is to provide an analytical treat- 
ment for the problem of network synchronization in a 
noisy environment with time delays. To that end, we 
shall first analyze the asymptotic behavior of (h 2 (oo)) 
near the two boundaries of the synchronizable regime: 
A — s- and A — » tt/2. As we shall show below, in these 
limits the sum in (fTTJj) is dominated by solutions of the 
characteristic equation (|11[) with 5R(z) — > 0. 

In the A — > limit, the function /(A) has to scale as 



/(A^0)^i + O(l) 



(13) 



in order to reproduce the exact limiting case of zero delay, 
(h 2 {oo)) ~ D/X 0]. 
In the A — > tt/2 limit we find the pair of solutions 



z± = ±i 



±i- 



2 l + (f) 2 



(14) 



to the characteristic equation (|TT|) . where A = tt/2 — A^; 
1. Note that 



z + + Z- 



l + (f) 2 



A -> 



(15) 



in the A — > limit. Inspection of the denominator of 
Eq. pop reveals that the small value of the sum z + + z_ 
is responsible for the divergent behavior of /(A — > tt/2). 
Substituting (fT5"j) into Eq. (fTU)) . one obtains the leading 
divergent behavior of /(A) in the A — > ? (A — >• 0) limit: 



/(A -1)^+0(1) 



(16) 



The simplest analytic function which satisfies both 
asymptotic behaviors (fT3|) and (|T6| is 



/(A) 



1 



A ?r(f - A) 



(17) 



where c is a constant. Note that this function has a single 
minimum at 



A* = 



r 3/2 



2(7^+2) 



(18) 



We note that the numerically computed value A* « 0.73 
is astonishingly close (~ 1% difference) to the analyt- 
ical expression (fTg|) . 

In order to fix the value of the constant c in (jTTJ) , 
one may calculate the sub-leading (constant) term in Eq. 
(fT"3")) . In the A — » limit we find the solution 



-A - A 2 + (9(A 3 ) 



(19) 



to the characteristic equation (fTTj) . Inspection of the de- 
nominator of Eq. dTDJ) reveals that the small value of z$ 
is responsible for the divergent behavior of /(A — » 0). 
Substituting (I19|) into Eq. (fT0|) . one obtains the leading 
divergent behavior of /(A) in the A — > limit: 



/(A^0)~-+1 . 

Equating Eqs. JT7]| and ([201) for A 
1 — 8 /7r 2 , which implies 



1 



(20) 



0, one finds c 



/(A) = T + 



A tt(§-A) 



(21) 



for the scaling function in (fT2|) . 

Substituting A* from (fT8j) into (l2"Tj) . one obtains the 
minimal value 



fn 



/(A*) = 1 + 27T- 1 +8tt- 3 / 2 



(22) 



Again, we note that the numerically computed value 
/min ~ 3.1 [2| is remarkably close (~ 1% difference) to 
the analytical expression (f22j) . 

In figure [T] we depict the scaling function /(A) = 
(Ji 2 (oo))/Dt as given by Eq. (|2"Tj) . This figure should 
be compared with the numerical results presented in Fig. 
2 of Q. We find an almost perfect agreement between 
the analytical function ([21]) and the numerical results of 
Ref. 0. 

From Eqs. (TT51) and (|2"21 one learns that for a sin- 
gle stochastic variable governed by Eq. © with a 
nonzero delay, there is an optimal value of the relax- 
ation coefficient A* = 7r 3 / 2 /2(y / 7r + 2)r, at which point 
the steady-state fluctuations attain their minimum value 
(/i 2 (oo)) min = Dt(1 + 27T- 1 + 8tt- 3 / 2 ) 0, see also 0. 

Returning to the context of network synchronization, 
one can calculate from Eqs. ([5]), (fT2j) and (l2~Tj) the steady- 
state width of the network-coupled system: 



fc=l 



[— 



7T(f -AfcT) 



(23) 



Thus, for large A^ the fundamental limit of synchroniza- 
tion efficiency is given by [see Eq. (|22p j: 

(24) 



(w 2 (oo)) min = Dt(1 + 27T- 1 + 87r- 3 / 2 ) 



This is the minimum attainable width of the synchro- 
nization landscape in a noisy environment with uniform 
time delays. 




FIG. 1: The scaling function /(A) = (/i 2 (oo))/7>r = A" 1 + 
^(f — A) -1 + 1 — in the synchronizable regime < A < 
7r/2. Compare this figure with the numerically constructed 
function presented in Fig. 2 of 



So far we have studied the characteristics of the syn- 
chronization network in the steady state (t — > oo) regime. 
Another interesting characteristic of the synchronization 
problem is the relaxation time of the network, the time 
it takes for the system to relax to its finite steady-state 
width (in the synchronizable regime, < Ar < ir/2). As 
we shall now show, this relaxation time diverges in the 
At — > 7r/2 limit, where the system undergoes a phase 
transition from a synchronizable state to an unsynchro- 
nizable state. 

Taking cognizance of Eq. ©, one realizes that the 
relaxation phase of the network (into a steady state be- 
havior) is governed by the solution of the characteristic 
equation (fTT|) with the largest real part [Since ^R(a) < 
in the synchronizable regime, this amounts to the solu- 
tion of Eq. (jlll) with the smallest absolute value of the 
real part.] Inspection of Eq. ([9]) reveals that the charac- 
teristic relaxation time, T(A,r) [l8j]j is given by 



T : 



2min{|^(z«)|} 



Taking cognizance of Eq. (|T4"]) . one finds 



T a = t 



l + (f) ; 

7rA 



(25) 



(26) 



for the diverging relaxation time of the coupled network 
in the vicinity of the phase transition (the A — > regime). 

Further, inserting the pair of solutions {z+,z_} from 
(fT4")) into ©, one obtains the late-time behavior of the 
network near the phase transition: 



(h 2 (t)) ~ (/?(oo)) - 



4Dt 

7tA ' 



-*/7a 



1 



[l + (f) 2 ] 2 



[(|) 2 - l]sin(7rf/r) + 7rcos(7rf/T) j . (27) 



4 



We thus find that the approach of the network to a 
steady-state behavior is characterized by damped tempo- 
ral oscillations of period 2r and a characteristic lifetime 
Ta- It is worth noting that these characteristic oscilla- 
tions are clearly visible in the numerical results of Hunt et 
al. (see Fig. 1 of 0). Observe, in particular, the tem- 
poral oscillations in the plots for At = 1.5 and At = 1.6 
which are near the threshold value At = ir/2 of the phase 
transition flil]). 

In summary, in this Letter we have analyzed the prob- 
lem of network synchronization in a noisy environment 
with uniform time delays 0. In particular, we have de- 
termined analytically the fundamental limit of synchro- 
nization efficiency (the minimum attainable value of the 
width of the synchronization landscape): (w 2 (oo)) m ; n = 
Dt(1 + 2n~ 1 +87r~ 3 / 2 ), where r is the characteristic time 
delay in the communication between pairs of nodes. We 
have shown that the optimal efficiency of the network is 

3/2 

achieved for At = - \- , , , where A is the relaxation coef- 
ficient (coupling strength). These analytical results are 
in perfect agreement with the recent numerical results of 
Ref. [2(. Further, we have analyzed the relaxation time of 
the network and showed that it diverges in the threshold 
limit At -> n/2. 

Our results provide a direct analytical explanation for 
the intriguing trade-off phenomena (between the time de- 
lay t and the coupling strength A) observed in recent 
numerical simulations [2[ of stochastic synchronization 
problems with time delays. 
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